How Much Testing is Enough? Applying Stopping Rules to Behavioral Model Testing
نویسندگان
چکیده
Testing behavioral models before they are released to the synthesis and logic design phase is a tedious process, to say the least. A common practice is the test-it-to-death approach in which millions or even billions of vectors are applied and the results are checked for possible bugs. The vectors applied to behavioral models include functional vectors, but the significant amount of the vectors are random in nature, including random combinations of instructions. In this paper, we present and evaluate a stopping rule that can be used to determine when to stop the current testing phase using a given testing technique, and move on to the next phase using a different testing technique. We demonstrate the use of the stopping rule on two complex VHDL models that were tested for branch coverage with 4 different testing phases. We compare savings and quality of testing both with and without using the stopping rule.
منابع مشابه
How Much Can We Save the Cost from Shifting from Single - Test Strip to Multiple - Test Strip in Point of Care Testing Analysis for Common Clinical Chemistry Parameters ?
متن کامل
Designing and Testing a Causal Model of Academic Adjustment Based on Behavioral Emotion Regulation with the Mediating Role of Mindfulness in Orphan and Poorly Supervised Students: A Descriptive Study
Background and Objectives: The educational, social, and psychological problems of Orphan and poorly supervised students need special attention. Therefore, the present study was performed with the aim of designing and testing the casual model of academic adjustment based on behavioral emotion regulation with the mediating role of mindfulness in orphan and poorly supervised students. Materials a...
متن کاملOn statistical behavior of branch coverage in testing behavioral VHDL models
During behavioral model verification, it is important to determine the stopping point for the current test strategy and for moving to a different test strategy. It has been shown that the location of the stopping point is highly dependent on the statistical model one should choose to describe the coverage behavior during the verification process. This paper presents a study on the coverage beha...
متن کاملPartial Knowledge in Multiple-Choice Testing
The intent of this study was to discover the nature of (partial) knowledge as estimated by the multiple-choice (MC) test method. An MC test of vocabulary, including 20 items, was given to 10 participants. Each examinee was required to think aloud while focusing on each item before and while making a response. After each test taker was done with each item, s/he was ...
متن کاملAn automatic test case generator for evaluating implementation of access control policies
One of the main requirements for providing software security is the enforcement of access control policies which aim to protect resources of the system against unauthorized accesses. Any error in the implementation of such policies may lead to undesirable outcomes. For testing the implementation of access control policies, it is preferred to use automated methods which are faster and more relia...
متن کامل